Approximate Maximum Flow on Separable Undirected Graphs * 



oo 



Gary L. Miller Richard Peng ^ 

CMU CMU 
glmiller@cs . emu . edu yangpQcs . emu . edu 

(N : October 19, 2012 

o 

(N 

^ ' Abstract 

O: 

We present faster algorithms for approximate maximum flow in undirected graphs with good sepa- 
rator structures, such as bounded genus, minor free, and geometric graphs. Given such a graph with n 
vertices, m edges along with a recursive y^-vertex separator structure, our algorithm finds an 1 — e ap- 
proximate maximum flow in time O(m^/^poly(e^^)), ignoring poly-logarithmic terms. Similar speedups 
are also achieved for separable graphs with larger size separators albeit with larger run times. These 
(H) ■ bounds also apply to image problems in two and three dimensions. 

C/3 , Key to our algorithm is an intermediate problem that we term grouped L2 flow, which exists between 

maximum flows and electrical flows. Our algorithm also makes use of spectral vertex sparsifiers in order 
to remove vertices while preserving the energy dissipation of electrical flows. We also give faster spectral 
vertex sparsification algorithms on well separated graphs, which may be of independent interest. 

>: 

C 1 Introduction 

CN ■ The maximum flow problem is a fundamental algorithmic question introduced by Ford and Fulkerson 
■ [FF56] and studied extensively since. In its simplest form, the problem asks for a flow f in a graph G that 
] routes the maximum amount from a source s to a sink t, subject to the constraint that the amount of flow 
[ on each edge does not exceed its capacity. 
T— I ■ Due to its origins in studying railroad network problems [HR56] , the maximum flow problem on planar 

j> . graphs has also received considerable attention. The Ford-Pulkerson paper gives an algorithm for the case 
where s and t lie on the same face [FF56]. In this setting a long line of work [Has81, JV82, MN95] led to 
a nearly-linear time algorithm on directed planar graphs[BK09]. In the case of undirected graphs, which 
5^. our work addresses, the running time has been brought to as low as O(nloglogn) [INSWNll]. While 
originally intended for transportation problems, these algorithms also have a wide range of applications in 
computer vision [Bor08]. 

Many applications contain a number of irregularities that are either intrinsic or added by the user. 
These irregularities are sufficiently common to be studied in early works on planar separators by Lipton 
and Tarjan [LT79] (e.g. a 2D finite element graphs where one connects any two vertices that share a face). 
They can take the form of bridges in transportation problems, or extra correlations in non-local methods for 
images [BCM08]. As a result, algorithms resilient to a small number of edge changes are needed to handle 
many of these instances. Progress in this direction was made by Chambers et al. [CEN09b, CEN09a], who 
gave an algorithm for s-t maximum flow on a genus g graph with integer capacities summing up to C that 
runs in 0(poly((7)nlog^ nlog^ C) time. 
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It is also possible for small modifications to introduce highly connected minors while preserving the 
overall structure of the graph. For example, two or more layers of an 0{y/n) x 0{^/n) grid with cor- 
responding vertices connected on the layers is similar to the (planar) square grid, yet has a large 
minor. Graphs similar to this often occur in computer vision problems involving 3-D images, or 2-D videos 
[VSN09, LFIO]. As a result, we believe that a more robust algorithm can be directly used for a considerably 
wider range of applications. 

In this work we introduce a novel approach for computing approximate maximum flow on these graph 
families. We show that good separator structures alone are sufficient for faster algorithms for computing a 
flow within 1 — e of the maximum flow. Our work is based on the multiplicative weights method recently 
used by Christiano et al. [CKM+11] in their faster approximate maximum flow algorithm. We develop 
a two-level, recursive approach that gives even faster algorithms on separable undirected graphs. To our 
knowledge, the only previous work using just separator structures was by Imai and Iwano [II90]. Their 
algorithm takes advantage of the separators by speeding up the L2 minimizations, giving a running time 
of about 0(m^'^^). As a maximum flow algorithm, however, their result has been superceded by the result 
on general graphs by Goldberg and Rao [GR98]. 

The Christiano et al. algorithm uses very different techniques than previous work. Their algorithm 
constructs an approximate maximum flow by taking the average of a sequence of electrical flows, each 
constructed based on previous ones. These electrical flows are in turn computed using the nearly-linear 
time solvers for SDD linear systems introduced by Spielman and Teng [ST04, ST06, KMPlOa, KMPllb]. 
The solver algorithm can be viewed as recursion on a hierarchy of graphs, each increasingly sparser than 
the previous one. Direct adaptions of this type of recursion on gradually shrinking graphs have yielded fast 
approximate cut algorithms [MIO], albeit at the cost of some loss in the quality of the solution. This work 
naturally leads to the question of whether the Christiano et al. algorithm can be combined with some type 
of recursive routine to get faster algorithms with smaller errors. 

In a work joint with Hui Han Chin and Aleksander Mcidry [HMMP12] that addressed problems from 
image processing, we observed that a coarser grouping of edges leads to an intermediate problem between 
maximum flow and electrical flow. This problem, which we term the grouped L2 flow problem, has two key 
properties that we'll show. It can be used in place of electrical flows in the Christiano et al. algorithm and 
lead to fewer iterations when the groups are small. Furthermore, on well separated graphs, these problems 
can be approximated in nearly-linear time for intermediate values of k. Combining the decreased iteration 
count with the nearly-linear running time of each iteration gives a faster algorithm. Our algorithm can 
also be readily extended to many of the image processing related tasks, such as isotropic total variation 
minimization [GY04]. Due to the additional components of these objectives and the readiness of the 
extension, we restrict our presentation to only approximating the maximum flow. 

Our algorithm constructs the intermediate grouped flow problem based on a r-division, which are 
partitions of the graph into n/r groups each with small boundary of size 0{^/r). Then we show that 
vertices incident to edges from only one group can be removed using spectral vertex sparsifiers. This 
removal obtained by modifying the generalized nested dissection algorithm by Lipton, Rose and Tarjan 
[LRT79]. This result allows us to reduce the problem size by a factor of Q(-y/r), leading to savings in 
the cost of computing these flows. When given the separator structures generated by algorithms such as 
[LT79, KRIO, WNll], our main result gives: 

Theorem 1.1 Given a graph G = iy,E) with n vertices and m edges with vertices partitioned into a 
r-division along with recursive separator trees for each group, capacities u £ ?R.^ and source/sink vertices 
s and t, we can compute a 1 — e approximate maximum s — t flow in 0{m^^^e~^'^) ^ time. 

Our results are applicable to a variety of graph families where separators can be found efficiently. 
^We use 0(/(m)) to denote 0(/(m) log*^ for some constant c. 
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Families where nearly-linear time separator algorithms are known include planar [LT79], bounded genus, 
/i- minor free for fixed h [KRIO] and nearest neighbor geometric graphs [MTTV97]. For /i- minor free graphs 
with larger values of h (e.g. n^), speedups can still be obtained using the algorithm by Wulff-Nilsen [WNll], 
which runs in 0{n^^^^^^^^) time. 

Aside from giving the first speedup over approximate general flow algorithms for the class of minor-free 
and shallow minor-free graphs, our weaker requirement of separator structure have several other advantages. 
The requirement of a top-level partition into n/r pieces naturally incorporate 0{n/r) extra edges. When 
an even larger number of such extra edges are present, the performance of our algorithm can degrade 
smoothly to that of Christiano et al. algorithm by a suitable change of parameters. Similar modifications 
can also be done if the separators given are of size instead of ^/n. If /? < 2/3, a modified version of our 
algorithm still gives running times faster than O{m'^^^poly{e~^)) . 

This robustness of our algorithm means it extends naturally to multiple sources and sinks, which occur 
in a variety of applications. On general graphs, this can be handled by introducing a super source and 
super sink, then connecting all vertices to them with appropriate capacities. However, this modification 
can significantly change the connectivity structure. As a result this extension on planar graphs has been 
studied as an important problem on its own [MN95], with a nearly-linear time algorithm being a recent 
result [BKM"*^11]. The milder requirement of partitions and separators on the other hand can naturally 
incorporate a super source and sink. These two vertices can be incorporated as part of every partition 
with only additive constant overhead. This means the guarantees in Theorem 1.1 includes the multiple 
sources/sinks case, and may have other advantages in terms of robustness. 

Our results can also be combined with graph smoothing and sampling techniques [Kar98] to obtain 
speedups by a factor of about (m/n)^/^. As planar, bounded genus, and minor-free graphs have m = 0{n), 
this improvement is only applicable for dense graphs that have good underlying vertex separator structures, 
and we omit it from our presentation. 

The paper is organized as follows: Section 2 gives formal definitions of the tools we use. The main 
components of our algorithm and their interactions are described in Section 3. The analysis of these 
components are direct adaptations of known results, with error analyses incorporated appropriately. They 
are given in Sections 4, 5 as well as Appendices A, B. Possible extensions of our results are discussed in 
Section 6. 

2 Background and Notations 

In this section we review some of concepts and notation used in the paper. We use subscripts to distinguish 
between variants of variables and (•) to denote entries in vectors/matrices. 

2.1 Graphs, Graph Laplacians and Spectral Ordering of Matrices 

We use G = {V, E) to denote an undirected graph. If we orient each edge e = uv arbitrarily, the edge- vertex 
incidence matrix of G is defined as: 

{—1 if u is the head of e 
1 if u is the tail of e 
otherwise 

Given edge weights of G, w, we can define the Laplacian of G as L = B"^WB, where w is the diagonal 
matrix of edge weights. Entry-wise we have that L(m, v) is the degree of vertex u if v = u; — w^J„ if uv 
is an edge; and otherwise. Many of our routines have logarithmic dependency on the ratio between the 
maximum and minimum entry of w. In all of their invocations needed for our main result, this parameter 
is bounded by poly(n). As a result, this term can be viewed as an additional factor of logn and is not 
crucial to understanding our approach. In the formal presentation of our results, we will use U{w) to 
denote max(w)/ min(w), and will also apply this notation to other vectors. 
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We will use L interchangeably with G. When the underlying graph is not clear from the context, we will 
also denote it using L(G). It can be shown that graph Laplacians are positive semi-definite. A standard 
notation that we'll use repeatedly throughout our presentation for comparing matrices is <. Specifically, if 
A and B are positive semi-definite matrices, we use A ^ B to denote that B — A is positive semi-definite. 
Or in other words, x-^Ax < x-'^Bx for all vector x. We will also use = Ai(L) < A2(L) < . . . < A„(L) to 
denote the n eigenvalues of L. 

2.2 Approximate Maximum Flow 

If we're also given capacities on the edges oi G, u : E ^ JR"*". Then for a flow on G, f : — )• K"*", we can 
define the (undirected) congestion of this flow w.r.t. edge e as: 

cong(f,e) - l^^""^' 



u(e) 

In an undirected graph, the requirement that a flow obeys capacities can be expressed as cong(f, e) < 1. 
We would also like the flow to meet certain demands at vertices. Speciflcally given a demand vector d that 
sums to 0, this constraint can be written as B"^f = d. Since we're allowed to add a super source/sink, one 
demand vector of particular interest is d being only non-zero at two vertices, s and t. This corresponds 
to the s-t maximum flow problem, which seeks to maximize the amount of flow entering t (or equivalently, 
exiting s) while obeying capacities and routing the same amount in and out of all other vertices. The 
approximate maximum flow problem in turn becomes finding a flow that routes at least 1 — e of the 
maximum amount. As flows on connected components behave independently of each other, we may also 
assume that G is connected. 

2.3 Electrical Flows 

Given a set of resistive values on the edges, r : E ^ K^, the electrical energy dissipation of a flow f, <?f(r), 
can be defined as: 

ff(r)=^r(e)f(e)2 

e 

The set of resistances also defines a natural graph Laplacian, namely L = B"^R~^B. For a demand d, 
let f denote the flow that minimizes the electrical energy and let £{t) = <ff(r). We use the following facts, 
shown in Section 2.3.1 of [CKM+11], about the energy dissipation of the optimum electrical flow. 

Lemma 2.1 

£{r) = (fL+d 

Where d is the column demand vector, and L'^ is the pseudo-inverse of L. 



A more thorough treatment of various properties of electrical flows and associated voltage values can 
be found in [DS84]. In order to compute electrical flows, we invoke the following result about computing 
almost-optimal electrical flows using SDD linear system solvers 

Theorem 2.2 There is an algorithm ElectricalFlow such that when given a weighted graph G = 
{V,E, r), along with any demand vector d such that the corresponding minimum energy flow is f. Elec- 
tricalFlow computes in 0{mlog{U{r)6~^)) time a flow f such that 

1. f meets the demands B^f= d 
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2. e(f) < (1 + b)e(r) 



3. For every edge e, |r(e)/(e)^ — r(e)/(e)^| < 6£j{r) 



A more detailed discussion of electrical flows, and its natural dual, effective resistances, can be found 
in Section 2 of [CKM+11]. 

2.4 Graph Separators 

Our algorithm makes extensive use of separator structures, both as r-divisions and as recursive separator 
trees. A single vertex separator can be formalized as: 

Definition 2.3 On a graph G with vertex set V, a subgraph S is an a-separator ifG\S can be partitioned 
into two graphs G^^^ and G'-^-' such that there are no edges between them and \V{G^^^)\,\V{G^^^)\ < a\V{G)\. 

There is a rich literature on efficiently finding such separators for planar, bounded genus, minor free, 
and geometric graphs [LT79, MTTV97, KRfO, WNlf]. Our algorithms do not change the connectivity 
of the graph, and use the separators repeatedly. As a result, we treat structures related to separators as 
separate entities computed before running our algorithms. 

Given a subgraph G' of G, we let its vertex boundary V^dryiG') be vertices that have edges to 
V \ V{G') and denote V{G') \ Vbdry{G') as Vintr{G'). We can now define r-divisions, which are multi-way 
partitions of V{G). 

Definition 2.4 A r-division of a graph G = {V, E) is a partition of it into groups . . . G^'^) such that 
each edge belongs to exactly one group and: 

• The number of groups, k is at most O(^) 




Fredrickson [Frc87] showed that with an extra log n factor in running time, one could compute separators 
repeatedly to obtain a r-division of the graph into pieces of size 0(r). In the planar case this was further 
improved to linear time by Goodrich [Goo95]. 

One of our algorithms for finding sparser equivalents of each group makes use of a recursive separator 
trees. These are obtained by recursively computing separators on the components, leading to a hierarchical 
partitioning of the graph. These structures were first used in nested-dissection algorithms [GT87, LRT79]. 
A subtle, but significant distinction exists in their construction. For planar, or more generally sparse- 
contractible graphs, it was shown that building separators on each component suffices for a fast algorithm 
[GT87]. However, if we are to only assume separator based properties, we need also keep the separator 
itself in one of the components. This ensures that the separator itself is partitioned in future layers, and 
won't eventually become a bottleneck in the algorithm. Lipton, Rose and Tarjan [LRT79] showed in their 
generalized nested dissection algorithm that these more carefully constructed separator trees alone are 
sufficient for good guarantees. The separators trees that we rely on are based on their construction and is 
described below. 

Definition 2.5 A recursive a-separator structure S{G) for a graph G = {V,E) is a tree where each node 
corresponds to a subgraph and satisfies the following properties: 

• The root node equals to G. 




• < r 

• The number of boundary vertices of each group, Vi,dry{G^^^ 
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• Each leaf node G has \ V{G)\ < C, where C is an absolute constant. 

• Each non-leaf node corresponding to graph G has a a- separator S. Furthermore its two children 
corresponds to graphs induced on G^^^ U S and G^"^^ U S with edges in S belonging to both. 

Theorem 1 of [LRT79] showed that finding the full separator tree can also be done with an extra log n 
factor overhead in the running times of computing separators. 

2.5 Schur Complement 

The partition of V into Vintr) and Vhdry naturally allows us to partition L into 4 blocks: 



intr ^mid 

T T 

mid ^bdry 



Note that by our assumption of G being connected, hintr is invertible when both Vbdry and Vintr) are 
non-empty. The Schur complement acts as a smaller-sized equivalent of L on only the boundary vertices. 

Definition 2.6 The Schur complement of a graph Laplacian L with respect to a set of boundary vertices 
Vbdry, SchurComplement(X, Vbdri/) is: 

T _ r-i T 

^bdry ^mid^intr^^'^d 

We will also label objects associated with the Schur complement with the subscript schur- Specifically, 
the Schur complement itself will also be denoted using schur- 

3 Overview of Our Algorithms 

We present a summary of our results in this section. The bounds for our algorithms are probabilistic due to 
calls to spectral sparsifiers [SS08] that randomly sample graphs. It was shown in [KLll] that with constant 
factor slowdown in running time, these routines can succeed with high probability. Therefore we omit the 
failure probability in the guarantees of our algorithms to simplify our presentation. An example of applying 
our algorithm to an instance on a square mesh is given at the end of this section, with illustrations given 
in Figure 1. The running time of various components are also given in Figure 2 in Section 6. It might be 
helpful to refer to this example, for intuition on the purposes of each component of our algorithm. 

The Christiano et al. algorithm [CKM^ll] showed that electrical fiows can be combined to form a flow 
that approximately meets all the edge capacities. This connection between electrical and maximum flows 
can be illustrated by a closer look at the objective functions of these two flows. Maximum flow imposes 
capacity constraints of f(e) < u(e) on each edge, which are equivalent to (f(e)/u(e))'^ < 1. The weights in 
the (e, p) oracle, and in turn electrical flows can be viewed as a way to create a single constraint from all 
m edges, in the form of ^(^)(^(^)/^(^))^ — Se^(^)- 

Instead of aggregating these into a single constraint, we can aggregate over k groups of edges, leading 
to an intermediate problem. The congestion of an edge can then be generalized to that of a group of edges, 
and we define cong(f, as the square root of the total energy among edges in the i-ih. group, G^*^: 



cong(f, i) = / E w(e)f(e)^ 

Y ee£;{G(*)) 

Then given a demand vector d, an instance of grouped L2 flow can be formalized as minimizing the 
maximum congestion over the k groups. 
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Definition 3.1 A grouped L2 flow problem is, given a graph G = {V, E) and edge weights w, source/sink 
pair s and t, along with a partition of the edges into Si, . . . ,Sk, find a flow f that meets the demands, 
B^f= d. The congestion of this flow is the maximum congestion over all groups, maxj cong{f,i). 

This problem is also the natural dual of the grouped least squares problem introduced in [HMMP12], 
which generalizes a variety of objective functions from image processing. We say that an algorithm ap- 
proximates grouped L2 flows if given a graph where there exists a flow f with cong(f, i) < 1 — e, it returns 
a grouped L2 flow with cong(f, i) < 1 + e, and possibly "fail" otherwise. We show in Section 4 that if 
each group has at most r edges, the approximate maximum flow problem can be solved using a sequence 
of about r^/^ approximate grouped L2 flow problems. 

Lemma 3.2 Suppose we have access to a routine for approximating grouped L2 flows, ApproxGroupedFlow. 
// G^^\ G^^^ . . . G'-'^-* satisfy |G*-*^| < r and e < 1/2, an 1 — e approximate maximum flow can be computed 
by 0(r^/^e^^/^) calls to ApproxGroupedFlow. Furthermore, in each of these calls, the edge weights w 
satisfy U{w) < 0{m^e^^). 

The rest of our algorithm can then be viewed as giving a series of faster algorithms for approximating 
grouped L2 flows. We first show that the group L2 flows can be approximated in 0{k^^^) iterations, each 
involving a SDD linear system solve. This is done by modifying the algorithms from [CKM+11, HMMP12]. 
This algorithm and its analysis are described in Appendix A. Note that the number of iterations only 
depends on k, the number of groups. Also, this algorithm returns "fail" when it can certify that a grouped 
flow with small congestion does not exist. As a result, our approximate max-flow algorithm, as stated, only 
produces a flow. We show in Appendix D that it can be modified to return a cut of small value instead. 

Theorem 3.3 Given a graph G = (y,E, w) with edges partitioned into k groups Si . . . S^, along with an 
edge weight vector w : E ^ and a demand vector d : y — )• K. If there exists a flow f that meets the de- 
mands and satisfies cong(f, i) < 1—e, then GroupedFlow(G, d, w, e/10) returns in 0{mk^^^ log([/(u;))e^^/^) 
time a flow f where for all groups we have: cong{f, i) < (1 + e). 

We can combine this algorithm directly with Lemma 3.2 by grouping edges into k = 0{m/r) groups of 
size r. This leads to a total running time of: 

0(mA;i/3e-8/3) . 0(^1/2^-5/2) 
=0(m(m/r)i/Vi/2g-3i/6) 
=0(^4/3^1/6^-31/6) 

As r > 1, this cannot lead to an algorithm that runs faster than 0{m^^^). In order to obtain speedups, 
we need to reduce the m term in the computation of grouped flows. This term corresponds to the number 
of edges in the linear systems solved in each of the 0(A;^/3g-8/3) iterations needed for grouped flow com- 
putation. We do so using the property that each group's boundary is smaller than its size by a factor of 
about r^/^. For each subgraph G^*-*, we construct a smaller 'equivalent' of it that only contains vertices of 

The Schur complement described in Definition 2.6 is a natural way to find such a smaller graph on 
boundary vertices. However, the exact Schur complement is usually a dense graph with (r^/^)^ = r edges. 
We obtain further reductions by showing that for approximating grouped flows, a graph that's spectrally 
close to the Schur complement suffices. This allows us to use the tool of spectral sparsification [SS08], 
which generates sparse approximations to such dense graphs. Formally, we denote such approximations to 
the Schur complements spectral vertex sparsifiers: 
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Definition 3.4 Given a graph G and a set of boundary vertices VbdryiG). A graph Gschur on vertices 
ybdryiG) with Corresponding Laplacian Lgchur is an e-spectral vertex sparsifier for {G,VbdryiG)) if: 

1- Gschur has d{\VMry{G)\e~'^) edges. 

2- Gschur and SchurComplement(L, Vi„jr)) are spectrally close. 

(1 ^^J-'schur —-^schur (1 ~1~ ^^Lschur 

3. U{w{Gschur)) < poly{n)U{w{G)). 

Our speedup is obtained by solving the grouped L2 flow problem on a graph with all groups replaced by 
their spectral vertex sparsifiers. The conversion of flows to and from the smaller graph is analyzed in 
Section 5. It leads an algorithm ApproxGroupedFlow whose running time is about 0(m^/^r~^/^ + m). 
This can be viewed as depending inversely on r, the size of the groups, or being proportional to the number 
of groups. 

Theorem 3.5 Let G = (V, E, w) be a graph where there exists a grouped L2 flow meeting demand d with 
maximum congestion 1 — e. Given a r-division of G and e/lO-spectral vertex sparsifiers for all the groups, 
ApproxGroupedFlow returns in 0{m^^^r~^/^e~^^^^log{U{w)/e) +mlog{U{w)/e)) time a flow meeting 
demands d where each group has congestion at most 1 + e. 

Note that when r > 0{m'^^^), this total running time is about 0{m). Therefore, running time bottleneck 
now moves to the cost of computing spectral vertex sparsifiers of the 0{m/r) groups, each with 0(r) edges 
and 0(r^/^) boundary vertices. In the rest of this section, We outline our spectral vertex sparsification 
algorithms. They're consequences of known results of using high quality approximate solvers instead of 
exact inverses, applied both once or recursively within the generalized nested dissection framework. Details 
and proofs on them are given in Appendix B. 

A direct approach is to compute the Schur complement as Definition 2.6, with sparsification done both 
before and after computing the Schur complement. Since Ijintr is diagonally dominant, we can invoke SDD 
linear system solvers on I-iintr with on each column of Ijmid- This gives an almost-exact approximation to 
^Tntr^mid in about 0(r^-^) time. Multiplying L^.^ against this 0(r^/^) x 0(r^/^) matrix takes 0(r^/^) 
time as Ijmid has 0(r) non-zero entries. Analyzing the error incurred from the solver and applying spectral 
sparsification at the end leads to a one-step construction of the spectral vertex sparsifier: 

Lemma 3.6 Given a graph G = {V,E,w) with n vertices and m edges and error bound < e < 1/2. 
There is a routine OneStepVertexSparsify that returns in 0(m + \Vhdry{G)\ne~'^ log{U{w))) time an 
e-spectral vertex sparsifier for {G,Vbdry{G)), Gschur, such that U{w{Gschur)) < 0{m^U{w)). 

Combining this with Theorems 3.5 and 3.3 gives a total running time of Oimre"'^/'^ -\-m'^/^r~^/^e~'^^/^). 
This is minimized when r = m^^^e"^, which in turn gives a total oidim^'^e-^^/^). 

This algorithm is applicable when we can find, or are given a good partition of our initial graph, but 
cannot do so repeatedly in the rest of the graph. For example, for shallow minor-free graphs (which are 
not guaranteed to have recursive separator structures), the result of [WNll] allows us to find the top level 
r-division in 0(n^/^) time, leading to an approximate maximum flow algorithm that runs in 0(m^/^e~^) 
time for shallow minor free graphs. In the more general case where each group of the r-division has a 
larger boundary of size r'', this type of runtime savings still hold. However, the gains stop at /3 = 2/3 
which corresponds to 3D cubes. 

For graphs which are recursively separable, we can take advantage of the existence of a full separator 
tree to speed up the computation of the spectral vertex sparsifier. Specifically we an algorithm analogous 
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to parallel nested dissection first introduced by Pan and Reif [PR93]. This approach ensures that every 
time we invoke the one-step algorithm given in Lemma 3.6, the boundary and interior are of comparable 
size. Interleaving sparsification at all stages with higher accuracy requirements leads to an algorithm that 
runs in 0{r) time. 

Lemma 3.7 Let G = {V, E, w) be a graph with n vertices and m edges given along with a 9/W-separator 
tree S. Given a partition of the vertices V into boundary and interior vertices such that \VbiiryiG)\ < 
0(ni/2), and an error parameter e , VertexSparsify(X, Vbdrj/IG), e/2 Iog2o/i9 ^t-) returns inO{m+ne ^logC/( 
time an e-spectral vertex sparsifier for {G,Vhdry{G)), Gschun such that U {w{G schur)) ^ 0{m^U{w)). 

This leads to a faster algorithm that finds an 1 — e approximate maximum flow in 0(m-r^/^e^^/^ + 
j^4/3^-i/3g-43/6-j ^^jjie on well-separated graphs. This is minimized when r = m-^/^e^^^/^, giving a total 
running time of 0{m^^^€~^^^^^) and in turn Theorem f .f . 

In order to give an overall picture of our algorithm, it's helpful to consider the case where we're trying 
to route flows from the top left to bottom right on a n^/^ x n^/^ square mesh. The grid structure is chosen 
for this example in order to simplify the description of the r-division. Of course, in this case the faster 
planar maximum flow algorithms can be used instead. However, all the steps are essentially the same for 
separable graphs. 




Figure 1: Illustrations of the main structures that occur in our algorithm from left to right (a) original 
graph; (b) grid partitioned into r-divisions; (c) exact dense spectral vertex sparsifier; (d) sparse spectral 
vertex sparsifier. 

We use this example to walk through the main steps of our algorithm on well-separated graphs. Given 
the input graph shown in Figure 1 (a), we decompose it into graphs with r = 0(n^/^) vertices, of which 
0(r^/^) = 0{n^^^) are on the boundary, (in this case, smaller squares with side length 0{n^^^)). This leads 
to A; = n/r = 0(n^/^) groups, giving the graph shown in (b). To find an approximate grouped L2 flow, 
we construct spectral vertex sparsiflers using Lemma 3.6 or 3.7. These graphs have both fewer edges and 
vertices, giving (d). An exact way of doing this sparsification is to remove all internal nodes of each group 
using partial Gaussian elimination, giving (c) where each group only has the 0(r^/^) = 0(n^/^) boundary 
vertices. However, these groups are now dense graphs and can have 0((r^/^)^) = 0(r) = 0(n^/^) edges 
per group. However, the combination of this and spectral sparsification [SS08] gives 0{r^^'^) = 0{n^^^) 
vertices and edges per group. From the perspective of grouped L2 fiow problem (b), (c), and (d) are 
roughly equivalent except that (d) is substantially smaller. Our algorithm then solves an approximate 
maximum flow problem on the grid (a) by averaging a sequence of grouped flows. The guarantees given 
in Lemma 3.2 leads to about 0(r^/^) = 0(n^/^) grouped L2 flows on graph (b). Each such instance is 
solved using the algorithm ApproxGroupedFlow described in Theorem 3.5. For each grouped L2 flows 



9 



on graph (b) we construct the smaller but equivalent instance (d) as described above in 0{n) time. We 
then solve the grouped L2 problems on (d) using Theorem 3.3, leading to a total running time of about 
0(n^/3r-5/6 + n) = 0(n). This running time can be further broken down into about 0{k^^^) = 0(n^/^) 
electrical flow computations described in Theorem 2.2. These take place on (d), which has size about 
0(n^/^). Once we have this approximate grouped flow, we can use the demands on the boundary vertices 
of each group to convert it back to a flow in that group in (b) that meets the same demand. Piecing 
these flows on all groups together gives a grouped flow in (b). The total iteration count of our algorithm 
is 0(r^/^) X 0((n/r)^/^) = 0(n^/^). Although this is slightly higher than the Christiano et al. algorithm, 
our overall running time is faster due to the smaller size of (d). Specifically, since 6(ni/5) calls to (b) are 
made, the total running time becomes 

4 Using Approximate Grouped Flows 

Our algorithm uses approximate grouped flows in a way similar to the use of electrical flows in the Christiano 
et al. algorithm [CKM+11]. They showed that electrical flows can be used as an {€,p) oracle as defined 
below. 

Definition 4.1 For e > and p > 0, an {e,p)-flow oracle is an algorithm that given demand d, a flow 
amount F and a vector Worade of edge weights with Woradei^) > 1 for all e, returns one of the following: 

1. If there exist a flow f that routes F units of flow from s to t and has max congestion 1, then output 
a flow f satisfying: 

(a) f routes F meets the demand, B^f = d 

(^) J2e'^orade{e)cong{f,e) < {1 + e)\Worade\l, wherC \Worade\l = Y^e '^oradeie) ; 

(c) cong{f, e) < p for all edges e. 

2. Otherwise, it either outputs a flow f satisfying conditions la, lb, Ic or outputs "fail". 

Christiano et al. showed that obtaining (e, p)-&ow oracles is sufficient for approximate maximum flow 
algorithms [CKM^ll]. We use Theorem 3.2 from their paper as our starting point: 

Lemma 4.2 (Theorem 3.2 from [CKM^ llj) For any < e < 1/2 and p > 0, given an {e,p)-flow oracle 
with running time T{m, 1/e), one can obtain an algorithm that computes a {\—0{e))- approximate maximum 
flow in a capacitated, undirected graph in time 0{pe~'^ •T{m, l/^))- Furthermore, all calls to the {e,p) oracle 
have U{w) < 0{m/e). 

It was also shown Section 2.2 of [CKM"'"11] that for finding an approximate maximum flow, it suffices 
to consider capacities with U{u) < 0{m/e). We show that grouped flows can be used to give (e,/?)-flow 
oracles. This is done by choosing the edge weights, w based on the weights given to the oracle, ^orade- 
The following proof is directly based on the on in Section 3.2. of [CKM+11], which shows that electrical 
flows can be used as (e, p)-?^ow oracles. 

Proof of Lemma 3.2: By Lemma 4.2, it suffices to provide an (e, 0(r^/^e^^/^))-flow oracle to the 
Christiano et al. algorithm. Let graph that we're given be G = {V, E), with edge capacities u; the demand 
of the flow be d and weights on edges be Worade- Let Worade{G^^^) be the total weight among edges in 
component i, aka. WoradeiG^^^) = Yle£E{G(^'i) ^orade{e). We set the weight of an edge e in component i to: 

^ ' u(e)2 Vwo.ade(G'W) 4|i?(G»)i; 
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Note that the assignments of edge weights have an extra u(e)^ term in the denominator due to 
cong(f, e) = This allows us to write the energy emitted on edge e in the following more conve- 

nient form: 

We first show that the existence of a flow f where cong(f, e) < 1 implies that cong(f, i) < 1 — e/10: 
cong(f,0'= Yl '«^(*)' 



<(l-e/2)(l + e/4) 
<1 - e/5 



Taking square roots of both sides gives the bound. 

Thus if ApproxGroupedFlow is run with an error bound of e/10, it returns a flow f where cong(f, i) < 
1 + e/10. This condition is equivalent to: 

(l + e/10)2 >cong(f,0^ 
>w(e)f(e)2 

By the assumption that e < 1/2, we have < (1 + e)^. Taking this into account and rearranging 

gives: 

We now show that this flow meets the requirements of an (e, 0(r-'^/^e~-'^/^))-flow oracle, namely the 
following two conditions: 

1. For each edge e G E{G^^), cong(f,e) < 0(|£;(G«)|V2e-V2) < 0(^1/2^-1/2) 
2- EeeE(GW) Worade(e)cong(f,e) < (1 + e)wo^acie(GW). 
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For Part 1, we take the first term in the weights and isolate edge e to get: 
Rearranging gives: 

cone (f,e)2 <{l + ef4\E{G'-'^)\ 
<0{e~^\E{G^'y)\) 

Taking square-roots of both sides again completes Part 1. 

For Part 2, we take the second part of the weight terms to get: 

Multiplying both sides again by Worade(G(*))^ = {^eeE{G(i'i)^oradeie))'^ and applying the Cauchy- 
Schwarz inequality gives: 

\e£E(G(i)) J \ee£;(G{«)) / \ee£;(G{0) 

\ ^ 

- X] Woracie(e)cong(f,e) 

\e6E(G(')) 

Taking square roots of both sides gives Part 2. 

It remains to bound the ratio between weights assigned to two edges e and e', we have: 

w e' <^7Y^ 1 + e < ^7\2 
u(e u(e 

, ^ ^ 1 - g/2 e e 



u(e)2 4|^(G«)| - 4mu(e)2 



w(e) \u(e')2y \ 4m 



, 8m / u(e) ^ ^ 



5 Converting Flows to and from Sparsifier 

We now show that an approximate grouped flow can be obtained from an approximate grouped flow on 
the graph where each group is replaced with a spectral a vertex-sparsifier. The differences between both 
vertices and edges of the two graphs makes a direct, embedding based mapping between flows on the 
edges difficult. As a result, our conversion process relies on computing locally optimal electrical flows and 
bounding their energy dissipations using guarantees of spectral sparsifiers. We only use the residue of the 
flows on the boundaries of each piece on to make this conversion. The energy of the optimum electrical flow 
given in Lemma 2.1 then allows us to (approximately) preserve the energy of flows between the original 
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graph and its spectral vertex sparsifier. 

Recall that as goal is to find s — t flows, we may assume that both s and t are on boundaries. More 
generally, we restrict ourselves to flows where internal vertices have zero demand. We first show that for 
the exact Schur complement, such fiows can be converted exactly. The following lemma is an re-statement 
of results on bounding the support of Steiner tree based support tree preconditioners [Gre96, MMP"*'05, 
KM08]. The usual proof is given in Appendix C for completeness. 

Lemma 5.1 For any demand vector d defined on the vertices of a graph partitioned into boundary and 
inner vertices such that the only non-zero demands are on the boundary vertices. Let dMry be the restriction 
of d onto the boundary vertices and Lgchur be SchurComplement(L, l^„tr))- Then we have: 

(fL^d= dl^^yL'^^i^^^dbdry 

By Lemma 2.1, these two terms correspond to energies of electrical fiows on the two graphs. This shows 
that if all inner vertices have zero demand, the demands on the boundary determine the minimum energy. 
However, due to the need to work with smaller problem instances, we can only use an approximation of 
hschur- Let this approximate spectral vertex sparsifier be hschur- The approximation guarantee given by 
Definition 3.4 is (1 — e)'Lschur ^ ^schur ^ (1 + e)^'schur- This error of 1 it e can be accounted for in the 
energy difference of the flows. This leads to the following Lemma, which allows us to convert between flows 
on two graphs whose Schur complement are similar. Note that since the spectral vertex sparsifier is only 
on the boundary vertices, it's a Schur complement of itself. 

Lemma 5.2 Given a graph G = {V{G), E{G), w{G)) and H = {V{H), E{H),w{H)) be connected graphs, 
with Vbdry{G) = Vbdry{H) and: 

SCHURC0MPLEMENT(G, VMry{G)) ^(1 + e)SCHURCOMPLEMENT(ff, Vbdry{H)) 

Iff{G) is a flow on G that meets demand d{G) that's only non-zero on boundary vertices. Then we can find 
f{H) on H such that the residuals of f{H) equals to dbdry on boundary vertices, and are in all interior 
vertices, and: 

Furthermore, f{H) can be found in 0{\E{G)\ + \E{H)\log{U{w{H))/e)) time. 

Proof Since G and H are connected, the null spaces of their Schur complements onto the boundary are 
the same. If we denote them as lischur 

(G) and ^schur{H\ the giving condition becomes: 

'-'schuT 

(H) ^ (1 + 6)L 

schur 

(G) 

Let d(G) and d{H) be the vectors formed by extending dbdry on to V{G) and V{H). Substituting dbdry 
into this bound and applying Lemma 5.1 gives: 

diHfL{H) + d{H) =dla,yL,,huriHy dbdry 

^(1 + ^)d'bdry^schur{G)^ dbdry 

={1 + e)d{Gf'L{G)+d{G) 

By Lemma 2.1, 'ff(G)(w(G')) > d(G)"^L(G)+d(G). This in turns implies that minimum energy fiow 
that routes d(H) in H has energy at most (1 + e)^^f(G)(w(G)). Invoking Theorem 2.2 with 5 = e then 
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returns a flow whose energy is at most: 



il + e)£{w{H)) <{l + ef£{w{G)) 

<(l + 3e)£:f(G)(w(G)) 

■ 

Note that smce d(G) = B(G)f(G) and each edge belongs to one of the groups, it can be easily de- 
composed into a set of k demands, one per group. We can find the residue from all edges in each group, 
and apply this conversion lemma to them. This leads to an algorithm for converting flows between graphs 
where each group are spectrally equivalent. Its pseudocode is shown in Algorithm 1. 

Algorithm 1 Algorithm for Converting flow between two graphs where Schur complements of all groups 
are close 

ApproxGroupedFlow 

Input: Graphs G and H, along with partitions of edges into groups G^^\ . . . , G^'^^ and H^^\ . . . , H^'^^ such 

that VbdryiG^"^) = VMry{H^^) and \.schur{H^^) < {I + €)\.schur{G^^) ■ Flow on f(G) meeting demand d(G) 
such that d(G) is only non-zero on boundary vertices. Error bound e. 

Output: Flow on f{H) meeting d{H) such that df)dry{H) = db^ryiG), d{H) is on all interior vertices, 
and cong(f(G),«) < (1 3e)cong(f(i?), i). 

1: Initiahze f{H) = 
2: for i = I . . .k do 

3: Compute the residuals of f(G) among edges in E(G«), d«(G) 
4: Form dW(i7) by taking 

^bdry(^) and putting on all interior vertices 

5: f^'\H) ^ ELECTRICALFLOW(GW,d(i),w(i)) 
6: end for 

7: Sum {^^\H) . . . f^'^^H) to form i{H) 
8: return {{H) 



Lemma 5.3 Let G and H be graphs with edge partitions G^^\ . . . , G^''^ and H^^\...,H^^^ such that 

VbdryG^'^ = VbdryH^'^ and 

^schur L schur {G^^'^ ) ■ Given a flow f{G) meeting demand d[G) that's 

only non-zero on boundary vertices and error bound e, Gonvert(G, iJ, /(G), e) produces in 0{\E{G)\ + 
\E{H)\log{U{w{H))/e)) time a flow f{H) such that: 

• f{H) meeting d{H) such that dbdryiH) = d^dryiG), d{H) is on all interior vertices. 
. congifiG),i) < {I + ?,e)cong{f{H),i). 

Proof By the given spectral condition between G^*^ and ff^*^ and Lemma 5.2, we have that: 

cong(f(i/),i)2 =£:^,)(^^(w(F«) 

<(l + 3e)£:f(.)(^)(w(G«) 
=cong(f(G),i)2 

Taking square roots of both sides gives the bound on congestion. 
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Note that since the computation of residuals is hnear and each edge belongs to one partition, we have: 

d(G)=j;d«(G) 

1=1 

k 
i=l 

Since d[^^^y(G) = d^f^^^^^H) and d^'^\H) are on interior vertices, we satisfy the requirement on d{H). ■ 
The faster algorithm that takes advantage of the e-spectral vertex sparsifiers is now clear. We take the 
restriction of d onto the sparsified graph, and find an approximate grouped L2 flow on it. Since each group 
now only consists of their boundary vertices, they're smaller by a factor of 0(r^/^), which compensates for 
the 0{k^^^) iteration count from Theorem 3.3. Once an approximate grouped flow is found on the smaller 
graph, we convert it to one that approximately meets the constraints on the original, unsparsified graph. 
Pseudocode of this algorithm is shown in Algorithm 2. 

Algorithm 2 Faster Approximate Grouped L2 Flows Using r-divisions 
ApproxGroupedFlow 

Input: Weighted graph G = {V, E, w) with an r-division partitioning it into groups Demand 
vector d such that only vertices on boundary of groups can have non-zero demand. Error bound e. e/10 
spectral vertex sparsifiers Jjschur 

for all the groups. 
Output: Approximate grouped L2 flow on G with congestion 1 + e 

1: Gonstruct Gschur by combining IjschuriG^^^) for 1 < i < fc. 
2: Let dgchur be the restriction of d onto the V{Gschur) 

3: GROUPEDFLOW(G,cft«r,S(G'(^))...^(G(^')),d,e/2) 

4: Let f be Gonvert(G, Gsc/iur, f, e/10) 
5: return f 



Proof of Theorem 3.5: We first show that the flow produced meets the requirement. By the require- 
ment of spectral vertex sparsifiers given in Definition 3.4, we have: 

(1 - e/10)L,,;,,,(GW) ^G2/,„r ^ (1 + e/10)L,,;,„,(G«) 

Assume there is a grouped L2 flow in G, f with congestion at most 1— e. Then applying Lemma 5.3 with error 
e/10 shows the existence a grouped L2 flow in Gschur with congestion at most (1 — e)(l + 3/lOe) < 1 — e/2. 
Therefore by the guarantees of the grouped flow algorithm given in Theorem 3.3, we get that f has 
congestion at most 1 + e/2. Applying Lemma 5.3 in the reverse direction, this time algorithmically, 
gives a grouped L2 flow in G with congestion at most 1 + e. 

It remains to bound the running time, which consists of running GroUPEdFlow on the vertex- 
sparsified graph, and converting the flow back. The cost of conversion is bounded by 0(m log(f7e~^)) 
and the cost of grouped L2 flow follows by the total number of edges in the components and k = 0{m/r). 
■ 

6 Comments / Future Work 

For readers who are familiar with the Ghristiano et al. algorithm, an alternate view of our algorithm that's 
closer to the multiplicative weights update framework is that it takes advantages of the grouping by making 
more aggressive readjustments of all edges in the same group. In this view we track and adjust another 
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set of weights defined for each component which are adjusted by the grouped L2 flow algorithm, while the 
per edge weights are adjusted less frequently in an outer layer. In the electrical flow computations, the 
resistive value of an edge then depends on both its weight and that of its component. 

To better understand the costs of our algorithm it's helpful to give a break down of the costs incurred 
by each component, ignoring constants and logarithmic terms. Such a list is given in Figure 2, where cost 
is the total cost incurred by all calls made by the component and number of calls is the total number of 
times this component is called in order to compute an approximate maximum flow. We now go over these 
procedures, their costs, and calling order. To compute a maximum flow we average Oir^/"^), the width 
of the oracle, grouped flows on the full graph. The grouped flow procedure makes several calls. It first 
computes spectral vertex sparsifier on each of the (n/r) groups. Then it computes a grouped flow on the 
sparsified graph by calling electrical flow (n/r)^/^ times. The grouped L2 flow on the sparsified graph is 
then converted to the full graph group-by-group. 
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Number of Calls 


Cost 


Total Cost 


Grouped L2 Flow on full graph 


n 


1 

T 2 


n 


1 

nr 2 


Spectral Vertex Sparsification 


r 


i , 
r2 X n/r 


r 


1 

nr 2 


Grouped L2 Flow on Sparsifier 


i 

nr 2 


i 

T 2 


n 


1 

nr 2 


Electrical Flow on Sparsifier 


i 

nr 2 


r2 X {n/r)i 


i 

nr 2 


4 i 
ns r 3 


Extrapolation of grouped L2 flow to full graph 


r 


i n 

r2 X — 

r 


r 


1 

nr 2 



Figure 2: Summary of components and their costs in a sparse graph parameterized in terms of r, the size 
of groups in the r-division 



Our recusive approach extends readily to multiple levels, but does not lead to better running times 
when we make more gradual reductions in graph sizes. The main reason is that the computation of spectral 
vertex sparsifiers in Appendix B first computes a dense and almost exact vertex sparsifier. The size of this 
dense graph at 0{\Vbdry{G^^^)\'^) is the bottleneck, although our algorithm only uses a sparsified version 
of it. We believe constructing the final spectral vertex sparsifier directly from the original graph is an 
interesting question on its own. On the other hand, for graphs with better separator structures such as 
graphs with bounded or low tree-width, this term is much smaller and improved running times are likely. 

Another possible way to obtain a speedup is to reduce the width of grouped flows to O(r^/^poly(l/e)) 
in a way similar to the Christiano et al. algorithm [CKM^ll]. The difficulty here is that their analysis 
requires tracking terms up to precision of roughly r~^/^, but going through spectral vertex sparsifiers incurs 
an error or e already. As a result, improvements in this direction will likely require a more robust analysis 
of the Christiano et al. algorithm. 

Finally, it's worth noting that all known hard instances for the current analysis of the Christiano et 
al. algorithm, such as the one given in Section 4 of [CKM^ll] have good separator structures. Whether 
this type of divide and conquer approach can lead to speed-ups for approximate maximum fiow on general 
graphs is an intriguing direction for future work. 
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A Algorithm for Approximating Grouped L2 Flow 

We now show that given an undirected flow instance where the edges are grouped into k groups, the max- 
imum L2 energy among the groups can be approximately minimized using about 0{k^^^e~^^^) iterations. 
The algorithm assigns weights to all the groups and adjusts them in an iteratively. We will use to denote 
that the variable is associated with the t-th iteration. Pseudocode of the algorithm is shown in Algorithm 
3. 

Algorithm 3 Algorithm for grouped flows 
GroupedFlow 

Input: Weighted, undirected graph G = (V, E, Si, . . . , Sk) with edges partitioned into Si . . . Sk and weights 
on edges given by w : — )• K^. Demand vector d and error bound e. 

Output: Either a flow f that meets the demands given by d and that cong(f, i) < 1 + lOe. Or "fail" indi- 
cating that no such flow with maximum congestion 1 exists. 

l; 10A:i/3e-2/3 

2: N ^ 20pln {k)e-^ = 200k^/^ In {k)e-^/^ 

3: Initialize Wgrp(«) = 1 for all groups 1 < i < k 

4: f ^ 0, Ni^O 

5: for t = 1 . . . iV do 

6: Compute /i^*"^) ^ J2i^9rp^\'^) 

7: Set r(e) to {wfrp^\i) + • w(e) for all edges e in group Si 

8: f^*'' = ElectricalFlow(G = {V, E), d, r) 

9: if £:j(t)(r) > then 
10: return "fail" 

11: else 

12: if cong(f, i) < p for all i then 

13: f^f+f^*^ 
14: Ni<^ Ni + l 

15: end if 

16: Update weights for all groups, ^^g}p{i) ^ ^%pP {i) ^1 + ^cong(f, z)^ 

17: end if 

18: end for 

19: return ^^f 



We first state the following bounds regarding the overall sum of potentials yU^*-* , the weight of a single 
group w^(*^ (i) and the effective conductance given by the reweighed energy matrices at each iteration, . 

Lemma A.l The following holds when jf^*^ satisfies 

Y,w%(i)cong{f ,i) < p^'-^^ 

i 

1. /iW < exp ( A u(*-i) 
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2. w^}p{i) is non- decreasing across iterations t, and if cong(j^^\i) < p we have: 

w%{i) > exp (^^cong{f^\i)^ 'wpp^\i) 

3. If for some edge e we have cong(jf^\i) > p, then £{r^^'^) > <?(r(*~^)) exp (j-^ 

The proof of Lemma A.l relies on the following facts about exp(x) when x is close to 1: 
Fact A. 2 1. If X >0, 1 + X < exp(x). 
2. IfO<x<e, then l + x> exp((l - e)x). 

Proof of Part 1 : 



■ ^ w^rp"'^''(^)(l + ■-cong(f''*\ i)) By the update rule 



w(t-i)(i)cong(f^^i) 



=/x(*-i) + - E ^tn^^ (i)cong(f^*^ , i) By definition of p^^-^^ 

^ i 

<p^''^^^ H — p^''^^^ By bound on total weighted congestion 
P 

=(1 + 

P 

<exp(-)/i(*-^) By Fact A.2.1 
P 



Proof of Part 2: 

If cong(f*"*\i) < p, then ^cong(f^*\ i) < e and: 

wg,(z) =w(*-^)(i) (l + -cong(f(*\i 



<wj-^) (i) exp |^^^i-^cong(f, J By Fact A.2.2 

■ (Part 2) 

In order to prove Part 3, we need the following lemma was proven in [HMMP12] about increasing the 
weight of a heavily congested edge. 

Lemma A. 3 Let f be the optimal electrical flow with flow value F on a graph G with resistances r. Suppose 
there is a subset of the edges S Q E that accounts for (3 of the total energy off, i.e. 

Y,~fiefrie)>f3£ir,f} 

ees 



I (Part 1) 
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For some 7 > 0, define new resistances ¥ such that r'[e) = (1 + e)r(e) for all e ^ S and r'{e) = r{e) for 
all e ^ S, then 

£{r^) < exp(-^)f(r) 

Proof of Part 3: 

Let i be the group such that cong(f, i) > p, then since 'Wgrp{i) > |/u: 

w(*-/)(.)co„g(f(^.)2>l/.(*-i)p2 

> £(r^^~^\f) By assumption of the energy of the flow returned 

k 

Invoking the guarantees given in proven in Part 3 of Theorem 2.2, we have: 

rW(e)f(e)2 > ^ r^^-^' (e)cong(f, e)^ - r(*-^)(e)cong(f, e)^ - r(*-^)(e)cong(f, e; 



>cong(f , i) — 6£{r 



By Part 3 of Theorem 2.2 



>^f-(t)(r(*-i))) - 6£(r^^~^h By Equation 3.1 
k f 



>- 



-{l + d)k 



f(r(*-i))-5£:(r(*'i)) By Part 2 



-2k ^ ^ 



Applying Lemma A. 3 with /3 = ^ completes the proof. 



4A; 

■(Part 3) 

Proof of Theorem 3.3: 

Since Z]i<i<fc(w3rp^'' («) + f/U*^*~^^) = (1 + e)//*^*~^\ if there exist a flow f such that cong(f,i) < 1 — 2e 
for all e, we have that £{r^^^) < (1 — e)^'^*^"'^^ Then if the algorithm does not return "fail", Theorem 2.2 
means that f''*'* satisfies: 



fjw(rW)<(l + <5)(l-e)/i(*-i) 



Multiplying both sides by /i*-* and applying the Cauchy-Schwarz inequality gives: 
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Taking the square root of both sides gives: 

^w(t-/)(.)cong(f(^.) <m(*-^) 

i 

Therefore inductively applying Lemma A.l Parti, we have: 

</i(0) • f exp(-) 

V p 

(eN\ 
= exp — m 

\ P J 
'21 In m 



< exp 

\ t ^ 

We now bound A^', the number of iterations t where there is a group with cong(f^*'', i) > p. Suppose 
f (r(o)j < 1/2, then in the flow returned, no group has cong(f^'''' , i) > 1, which means that the algorithm 
can already return that flow. 

Note that r^*) is monotonically increasing on each edge, so £{v^^^) is also monotonic. Then by Lemma 
A.l Part 3, we have: 

£(r'«))>l/2.exp(^?g^) 

Combining this with £{y^'-'^) < fi^^^ gives: 

e^p^N' 211nm 



4m 



<- 



, 100m In m 
N' < < eN 

Then in all the N — N' > (1 — e)N iterations, we have cong(f^*'' , i) < p for all groups i. This allows us 



to finish our proof by bounding the congestion of each group: 

t t 

. e 



cong(^^ f^*\ z) < cong(f*"*'', i) Since cong(-,i) is a L2 norm 



<log(/i(*))/(-) By Lemma A.l Part 2 
P 

=Y—J" ^ (1 + ^e)?"' 



B Spectral Vertex Sparsification 

This section described faster algorithms for spectral vertex sparsification. As the Schur complements of the 
Laplacian of a disconnected graph is the sum of the Schur complement of its components' graph Laplacians, 
we assume that the graphs given as input are connected. We will use the following lemma about the Schur 
complements of spectrally similar PSD matrices. 
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Lemma B.l Suppose L{G) and L[H) are matrices such that: 

{I - e)L{G) < L{H) < {l + e)L{G) 

Then let Lschur{G) md Lschur{H) he the Schur complements of L{G) and L{H) on the same set of 
vertices. We have: 

(1 — e)Lschur{G) :< Lschur{H) ^ (1 + e)Lschur{G) 

The following fact is crucial in relating energy of the Schur complement to that of the original graph. 
It can be viewed as an instance of the Dirichlet Principle (see [DS84], page 64), which states that enforcing 
intermediate voltages other than the naturally occurring ones only increases total power. For completeness 
proof of it is included in Appendix C 

Lemma B.2 

x^Lschur{G)x = mm ^ ) L[G) ^ 

Proof of Lemma B.l: We first show lower bound on JjschuriH). For a fixed vector x, let y the vector 
given by Lemma B.2 for Jj(H). Then we get: 



(1 - e)x^L,,;,„,(G)x <(1 - e) ( y ) L(G) ' ^ 



T 

X / ~ ' \ X 



=X 'Lschur{H)x 

For the upper bound on JjschuriH), once again let y be given by Lemma B.2 for L(G) and x. This 
gives: 

(1 + e)x^L,,;,,,(G)x =(1 + e) ^ ^ L(G) [ ^ 

^X Ligchur 

We can also establish bounds relating the spectrum of L^chur 

to the spectrum of L. 

Lemma B. 3 Lei isc/mr = SchurComplement(L, Vi„jr)), then: 

^2{L schur) >^2{L) 
^n{Lschur) ^nXn(L) 

Proof of it is given in Appendix C. 
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Recall from Definition 2.6 that the Schur complement can be obtained by partitioning L into blocks on 
the boundary and inner vertices: 

— T T T 

. ^mid ^bdry _ 

And evaluating Ij schur = ^bdry — ^mid^intr^rnid- Note that liintr is a graph Laplacian on the inner vertices 
with additional diagonal entries. This places it within the class of symmetric diagonally dominant (SDD) 
matrices. Furthermore, due to the graph being non-connected it is strictly SDD. We first show that the 
solves involving hintr can be done using faster SDD linear system solvers. We use the following result by 
Spielman and Teng on nearly- linear time solvers for such systems: 

Lemma B.4 [STO4, ST06, KMPlOb, KMPlla]. Given a strictly SDD matrix of the form A, and an error 
parameter 5, there is a symmetric linear operator B such that 

{l-5)A-^ ^B^ {l + 6)A-^ 

Furthermore, for any vector x, Bx can be evaluated in time 0(mlog(l/(5)) where m is the number of 
non-zero entries in A. 

A direct approach is to apply the linear operator corresponding to L^^^^ to I^mid- As this is done 
one column at a time, we use hmid[-,i] to denote the i-th column of Ijmid- Pseudocode for performing 
approximate Schur complements is given in Algorithm 4 

Algorithm 4 Approximate Schur Complement Using SDD Linear System Solvers 
ApproxSchur 

Input: Graph G = {V,E,w) with corresponding Laplacian L, boundary vertices Vbdry Spectrum bound k 
such that A„(L) < kA2(L), error parameter e. 
Output: Approximate Schur complement Lschur- 

1: Let Vintr) denote the interior vertices, V \ Vbdry 

2: 6 ^ 2en'^K^^ 

3: for i = I . . . \ Vbdry\ do 

4: Y[:,i] ^ SOIWE{Lintr,1-mid[-,i], S) 

5: end for 

6: ^schur ^ ^bdry — ^mid^ 

7: Let iischur be iigchur with positive off-diagonal entries replaced by Os and diagonal entries readjusted 

to weighted degrees 
8: return Lgchur 

Note that since the linear operator corresponding to Solve is symmetric, tj^chur symmetric. However, 
Solve only produces an approximation to the inverse. We next show that setting 5 to poly(n~^, [/(w)~^) 
suffices for approximating the Schur complement. We start with rough bounds on the maximum weight 
based on the eigenvalues. 

Lemma B.5 Let G be a graph with corresponding graph Laplacian L. The maximum weight of an edge in 
L is at most 2A„, and for any choice of boundary vertices, Lbdry ^ 2nXnI. 

Proof By the Courant-Fisher theorem applied to the vector with 1 on one end and —1 on the other, we 
get that its weight is at most 2\n- 
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Since Ijbdry is formed by taking a subset of the edges and adding weighted degrees to the diagonal, we 
have: 

Lfedry + nA„I ^ 2nA„I 

■ 

This ahows us to prove the multiphcative error guarantee. 

Lemma B.6 Given a graph Laplacian L for a graph G with n vertices and m edges, along with spectral 
bound K such that Xn{L) < kX2{L), and error bound < e < 1/2. Let L^chur be the exact Schur complement 
of (G,Vintr))- Then ApproxSchvk{G, Vbdry, i^,^) in O {\ybdry\ fn^og{Ke~^)) time outputs a matrix Lschur 
such that: 

(1 ^)-^schur — J-'schur (1 ~l~ ^^I^schur 

Proof 

We only show the LHS inequality as the RHS side follows similarly. Let B be the linear operator 
generated by Solve. Then by the guarantees given in Lemma B.4 we have B ^ (1 + (5)L~^^j,. This in turn 
gives L^i^BL^rf ^ (1 + (5)L^irfL-^^^L^irf and: 

T T T T pjT 

^schur ^bdry ^mid ^nid 

h'L'bdry - (1 + ^)^mid^intr^rnid 
=^schur ~ ^'^mid^intr^rnid 

Since ^bdry — ^mid^7ntr^rnid is the Schur Complement and is positive semi-definite, we may use Shbdry as 
an upper bound for the difference. Specifically we can use the bound on Jjbdry given above. Combining it 
with K2(Lschur) < A2(L) from Lemma B.3 finishes the bound: 

Lschur h.^'schur — (52nA„(L)I 

h^ischur — eA2(L)I 

We now bound the running time. The inner loop consists of iVb^r-j^l calls to Solve, each taking at most 
0(mlog5) to evaluate. These steps combine for a total of 0{\Vbdry\''TT'^og{Ke~^)). Also, L^^^ is a sparse 
matrix with 0{m) non-zero entries corresponding to the edges. So multiplying it against BL^idi which is 
has |Vf,rfj.j^| columns can be done in 0{\Vbdry\'m') time. Combining these two steps gives the overall bound. 

■ 

The requirements for AppROxSCHUR are stated in terms of spectrum to ease the use of it within 
recursive routines later in this section. We make use of the following lemmas to convert between rough 
bounds on edge weights and spectrum. 

Lemma B.7 Let G = {V, E, w) be a connected graph with corresponding graph Laplacian L. We can find 
in 0{m) time eigenvalue bounds Amin and Amax such that Xram < X2{L) < A„(i)Amax < 'n^U{w)X^in. 

Proof Let Wmin and Wmax denote the minimum and maximum weight in G. Since G is connected, it has 
a spanning tree consisting of edges of weight w^-^, giving Amin > ^Wmin- 
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Also, since all edge weights of G are at most Wmaxj we have L ^ WmaxL(i^ri) where Kn is the complete 
graph on n vertices. Therefore Amax = '^Wmax suffices and its relation with Amin follows from Wmax ^ 

Lemma B.8 Given a graph G = iy,E,w) and hound Amin < ^2{L). We can compute in 0{m) time 
another graph G' = {V,E, u/) on the same edge set such that the minimum edge weight in G' is ^Amin 
and: 

L^L' ^(1 + -)L 

n 

Proof We have ^^j" L(Er„) ^ where Kn is the complete graph on n vertices. Therefore adding ^^p^ 
to each edge of G gives G' . ■ 
Once we obtain the approximate inverse, its edge count can be reduced using spectral sparsifiers. The 
guarantees of the sparsification algorithm, first introduced by Spielman and Srivastava [SS08] is: 

Lemma B.9 [SS08, KLll] There is a routine Sparsify such that given a graph Laplacian Lq on n vertices 
with m edges and a parameter e. Sparsify(G, e) outputs in 0{rn\og{e~^)) time, a graph Laplacian Lh 
with 0{ne~'^) edges such that (1 — e)LG ^ L}{ ^ (1 + e)LG- 

Combining spectral sparsification with ApproxSchur completes the proof of lemma 3.6. The pseu- 
docode of OneStepVertexSparsify is given in Algorithm 5 

Algorithm 5 One Step Spectral Vertex Sparsification 
OneStepVertexSparsify 

Input: Graph Laplacian L corresponding to G = (F, £',w) with vertices V and boundary vertices Vbdry 
allowable error per step e. 

Output: Approximate Schur complement Jj schur- 



Let Amin = miue w(e) 
Let Amax = nmaxew(e) 

Let K — Amax/ Amin 

"l^schur ^ ApPROxSCHUR(G, Vury, K, e/3) 
^schur ^ SPARISFY(Lschnr,e/3) 

Add ;^Amin to the weight of all edges present in hgchur to obtain hgchur 
return 



■'schur 



Proof of Lemma 3.6: By Lemma B.7 we have the that Amin, Amax and k are bounds for eigenvalues. 
Lemma B.9 gives that L^^,^^^ has 0(ne~^) edges and: 

(1 - 6/3)L 

schur <Lschur ^ (1 + e/3)L schur 

Combining with Lemma B.6 gives that Lsc/iur meets the requirements of an e-spectral vertex sparsifier. By 
Lemmas B.l and B.2, 2k is sufficient as spectrum bound for L^^/,^^. Therefore using Lemma B.8 we have 
L ^ (1 + }i)i^schur ^ (1 + ^)^schur- Furthermore, the edge weights in L'J^^^^^ are at least ;^Amin and at 
most O(nAmax)) giving a bound of 0(n^C/(w)). As Sparsify runs in nearly-linear time and t-igchur has at 
most |Vbrfrj/P < |Hdrj/|"i edges, ApproxSchur is the bottleneck in the total run time. ■ 
We now move on to our multilevel recursive sparsification algorithm for graphs where we have access 
to a full separator tree. Pseudocode of our algorithm is shown in Algorithm 6 
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Algorithm 6 Recursive Spectral Vertex Sparsification for Well-Separated Graphs 



VertexSparsify 

Input: Node in separator tree S, graph G, with separator S and children G^^^ = {V^^\ E^^^) and G^"^^ = 
(y^'^\ E^'^'^). Graph Laplacian L corresponding to G with vertices V and boundary vertices Vbdry Spectrum 
bound K such that A„(L) < k;A2(L), allowable error per step e. 
Output: Approximate Schur complement hschur- 
1: for i = {1,2} do 

3: i'^slhur ^ VERTEXSpARSIFY(L(*\ V6(ir-y(G(*)), K, e) 

4: end for 

^schur ^ ^schur ' ^schur 
6: t'U^, ^ ApPROXSCHUR(LLft„„ Vbdry, 2^°S20/19 g/3) 

7: tschur ^^SPARSIFY(L!,'c^„^,e/3) 
8: return Lschur 



In order to provide error guarantees for VertexSparsify, we relate rough spectral bounds between. 
This in turn allows applications of Lemma B.6 in an inductive fashion. These guarantees can be summarized 
as follows: 

Lemma B.IO Let G be a graph with n vertices and m edges such that A„(G) < kX2{G), Given a partition 
of the vertices V into boundary and interior vertices such that \Vbdry\ ^ V^, a 9/10 separator tree S, and 
an error parameter e. 

Then L^^j^^j. as defined on Line 5 of VertexSparsify satisfies: 

XniKchur) <2^°S20/i«"kA2(XL,„,) 

And YektexSparsify{L, Vbdry J f^j^) returns Lgchur with 0{ne~'^) edges such that: 

(1 _ e)i°g2o/i9"2:^^^^^ ^ lschur ^ (1 + e)i°S2o/i9-i^^^^^ 

Proof The proof is by induction on n. Since |5| has size at most 0{y/n) we have that \Vbdry{G^^ I V^dr-y 
0{\/n). Then since the two graphs that we recurse on have size at most 9/lOn + 0{^/n) < 19/20n, by the 
induction hypothesis we have: 

d _ f)^og2o/-^gn-l-r{i) ^ T W ^ fl I f^log20/i9"-lL^*^ 

^) ^schur — ^schur -1 \^ ^ t-) ^schur 

Furthermore, we can compute an approximate Schur complement of this sum, only introducing an extra 
error of {i — l)/21ogne Let L'^^^^^^ be the (exact) Schur complement of {G,Vintr) \ S). Then invoking the 
induction hypothesis and summing over the two pieces gives: 

(1 _ e)i°g-/-"-iL;,,,, < l^schur ^ (1 + 6)i°^-/-"-^L'3,,„, 
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Combining this with the relation of the spectrum of Lischur and L gives: 

<(l + e)iog2o/i9nA„(L,,^„,) 
<(l + e)iog2o/i9«^A„(L) 

<(l + g)log20/19"^^A2(L) 

<(1 + e)i°g2o/i9"(i _ e)-'°s-/i«"nKA2(LL,„,) 

By assumption that e < 1/10, 

Therefore running APPROXSCHUR with spectrum bound of 2^°^2o/i9 satisfies the input requirements 
for in Lemma B.l. Let ^igchur turn be the exact Schur complement of removing S from L^^^j^^, Lemma 
B.l then gives that the approximation guarantee still holds. 

(1 - e)('°sw^«")-iL,,/,„, ^ ^ (1 + e)(i°S2o/i9n)-iL,,^,, 

By Lemma B.6, Lgchur satisfies: 

(1 ~ ^/3)L"c/iur — ^schur ^ (1 + ^/'^)^'schur 

Lemma B.9 gives an additional error of 1 it e/3 from the sparsification, as well as the bound on edge 
count. Including this error gives: 

(1 - e)L'4;j„j, ^ 'Lschur ^ (1 + ^)^schur 

Combining this with the bound between I-igchur and L"^^^^ shows the inductive hypothesis for n as well. 
■ 

We now turn our attention to the running time, which is dominated by the calls to ApproxSchur. 

Lemma B.ll Let G be a graph with n vertices and m edges such that \n{G) < i'^^2{G), Given a partition 
of the vertices V into boundary and interior vertices such that \VMry\ ^ V^, a 9/10 separator tree S, and 
an error parameter e, VERTExSPARSlFY(i, ^4^,.^, k, e) terminates in 0((m + | Vbdrj^p)e~^ log(K)) time 

Proof 

Since LscLr and tfchur combine for \VMry{G'^^^'^'>)\ + \VMry{G^^'^)\ < 2{\VMry\ + l^l) vertices, i'^chur has 
at most 0{{\Vbdry \ + |'S'|)e~^) edges by the induction hypothesis. So by Lemma B.6, the running time of 
this call is bounded by 0{{\Vbdry\ + \S\)\Vbdry\^~'^ ^og{K)). 

Therefore the total running time can be bounded by 0(e~^log(K)) times the total value of (|V;,dry| + 
I'S'DI Vfjrfr-j/l summed over all the recursive calls. We follow the proof of Theorem 2 of [LRT79], which 
bounds the fill of generalized nested dissection. We also and use f{l,n) to denote the maximum sum of 
dHdryl + |5'|)|Vferfry| over the recursive calls starting from a graph with n vertices, / of which are on the 
boundary. 

Let Co be the constant in the 9/10 separator tree where the separator size is at most CQy/n. Then the 
recursive calls guarantee that: 

• If n < no for some absolute constants C and no, then f{l,n) < C. 
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• Otherwise, f{l,n) < /(/ + Con) + /(/i, ni) + /(^2, ?^2) for /i, /2, ?i-2 that satisfy: 

h + l2<l + 2co^/^ 

ni, 71,2 <9/10n + co\Ai 

Then we show by induction on n that there exists an absolute constants ci and C2 such that: 

/(/, n) < cil^ log n + C2n log^ ?i 
The base case of n < no follows from C being a constant. For the inductive case the RHS is bounded 

by: 

cil\ log ni + C2ni log^ ni 

+ 01^2 log„2 +C2"'2 log^ n2 + Z(Z + CQ^/n) 
<ci log(max(ni,r72))(/? + /f) 

+ C2 log(max(ni,n2))(ni + 71-2) + + cqa/^) 

<Cl(log(7l)-log(10/9))(/l+/2)' 

+ C2(log(7i) - log(10/9))2(ni + 712) + l{l + co^/n) 
<ci(log(7i) - log(10/9))(/ + 2co^/^)2 

+ C2(log(7i) - log(10/9))2(n + co^/^) + /(/ + co^/^) 

By the arithmetic-geometric mean inequality we have I ■ c^y/n < (/^ + Co77)/2. Making this substitution 
gives: 

<Ci(log(77) - log(10/9))(/2 + 8C^77) 

+ C2(log(77) - log(10/9))2(77 + coV^) + 2/^ + cgn 
<(ci log(77) - ci log(10/9) + 2)/2 

+ (C2(l0g(77) - log(10/9))2 + 8C1 log(77)cg + cg) 77 
+ C2 log^(77)co\/r7 

By an appropriate choice of uq we can ensure that \o^{n)y/n < n, giving a simpler upper bound of: 

<(ci log(77) - ci log(10/9) + 2)/2 

+ (c2(log(7i) - log(10/9))2 + 8ci log(n)cg + 2c§) 77 

By choosing ci = 2/ log(10/9), we get the coefficient on P to be at most ci log n. Then since C2 log(77)^ — 
C2(log(77) — log(10/9))^ = 2c2log(10/9) — log(10/9)^, and ci, cq are fixed constants, a sufficiently large 
constant for C2 ensures the coefficient in front of n is also bounded by C2 log 77. Combining with the extra 
term of 0(e~^log(K)) gives the first term in the running time bound. An additional term of m is needed 
to account for the cost of the initial sparsification. 

■ 

Proof of Lemma 3. 7: The conversion between guarantees on edge weight ratio U (w) and spectrum 
can be handled in the same way as in Lemma 3.6. Combining Lemmas B.IO and B.ll, and adjusting 
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parameters by replacing e with e/21og2o/i9 n gives the required bounds. ■ 
C Proofs of Properties of Schur Complement 
Proof of Lemma 5. 1 : 

Let the vectors x be the solution to the solution to Lx = d. Partitioning x into 'x.bdry and n-mtr gives: 



T 



■'mid 














^bdry 




^bdry 



^mid ^bdry 

The equality given by the first set of blocks can be rewritten as: 

^intr^intr ~l~ ^mid^bdry — 

^intr ^iYii^^mid^bdry 

Substituting this into the second set of blocks gives: 

^mid^intr^^i<i^t>dry ~l~ ^bdry^bdry ^bdry 
i^bdry ~ ^mid^intr^'mi<i)-^bdry —^bdry 

^bdry ^schur^bdry 

Which if we substitute into d"^L^d and combining with the fact that d is only non-zero on the boundary 
vertices gives: 



d L d =df^a^yXbdry = d^dry^schur^bdryiV 



Proof of Lemma B.2: 

If we treat x as a constant, then the expression to be minimized can be written as: 



I Lemma 5.1 



T 



L(G)( 









^mid 


tT 

_ mid 


^bdry 



=y^^intry + 2y"^LmjdX + X^Lbdry^ 

The first two terms can be viewed as a quadratic in y, and is therefore minimized at y = — L^^^L^idX. 
Substituting this into the expression above gives: 



mm 

y 



L(G) 

Ljntry + 2y"^LmjdX + X^ Ijbdry^ 



T T T — 1 

=X LbrfryX — X L^j^L .jj^^LmirfX 



=X [Lbdry - ^mid^intr^rnid)^ 



-X L^f-Zj^^x 



Lemma B.2 
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Proof of Lemma B.3: 

Let X be any vector on the support of J^schur- Then by Lemma B.2 there exist a vector y such that: 

x^L,,,,,(G)x = ( ^ ) L(G) ( ^ ) (3.1) 

Furthermore, all entries of y are between the minimum and maximum entries of x, giving: 

x'^x <x^x + y'^y < nx^x (3.2) 

The bounds then follow by setting x to eigenvectors of \^schur and applying the Courant-Fisher theorem 
on L. ■ 

D Returning a Small Cut 

We now show that if GroupedFlow returns "fail", then a small cut can also be found. We begin by 
stating one omitted aspect of the electrical flow algorithm as given in Theorem 2.3 of [CKM+11]. 

Lemma D.l ElectricalFlow can he modified to return a set of vertex potentials (j) such that the energy 
given by the potentials £^{r) is at most 1, and dFcj) is at least (1 — 6)£(f). 

These vertex potentials are approximate versions of the voltages corresponding to the electrical flow. 
Since the vertex sparsified graph is approximately the same as the graph given as input to GroupedFlow, 
we show that this can be extended to a full set of potentials on vertices of the original graph, which in 
turn leads to a small cut. 

Theorem D.2 //GroupedFlow returns "fail", we can find in 0{m) time a set of vertex potentials 4> 
such that: 

1- ^e=uveE '^((^Mu - (^v\ < 1 
2. (f(t)>l- lOe 

Proof 

By Lemma D.l, in this situation a set of vertex potentials 4>schur on Gachur such that: (p^f.^^,^i^schur4>schur < 
1 and dj^^y(f)schur > fJ- where // = X^i<i<fc Wgrp(«)- Let the weights among edges given Oracle be w and 
the weights set in GroupedFlow be Wg^p. Furthermore, for e G E{G^^^) we use ^ comhined[&) to denote 
combined weight on e that does not account for its capacity: 

Wcom6med(e) =\i{efr{e) 



, /•^ ^ \ f w(e) e 

=(w<;,p(^) + -/i) • ( —Thnr, + 



k"^' Vw(G») |^(GW)| 

Consider each component i, let (j)schur{i) denote the restriction of 4>schur to the vertices on VbdryiG^^^). 
Since ischur{G^'^) ^ (1 + e)Lschur{G^'^), we have: 

<Pschurii)'^1^schur{G'^'''')4>schur{i) < (1 + €-)<f)schur{i)'^i'schur{G^'^)ci)schur{i) 
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Therefore by Lemma B.2, it's possible to extend (pschurii) onto the interior vertices of G^^^ to obtain 
(i) such that: 

Summing over ah clusters gives a vector tp such that: 



i<j<fc 

— ^ 4'schur{'i)^i'schur{G^^^)(j)schur{'>') 
l<i<k 

= (1 + e)4)^^huT^schur{G^'^'')<t>schur 

<l + e (4.3) 



Furthermore since d is in all interior vertices, we have: 



=dl^^y(f)schur > M 

Then consider </) = (14. |o^)^ • We have > 1 — lOe, and from Equation 4.3 we can obtain: 



(l + 10e)/i 

(l + 8e)^(<^^L0) <1 (4.4) 
Substituting in the fact that the resistive weig ht of edge e € -B(GW) in L is r(e) = """^/''^a'^ — gives: 



u(e)2 



rie 

l<i<fce=™e£;(G(^)) 

^ u(e)2(</,(^z)-0(z;))2 



e=uv&E{G(^^) 

Also, we have that the total sum of resistive values among all the clusters is: 
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^ ^ ^ combined{(') 
e 

Ev^ / /-N ^ \ ( w(e) e 



= (1 + e) E + 

l<i<fc 



<(1 + 3e);u 
Substituting into Equation 4.4 gives: 



1 >(l + 8e)/i((/.^L0) 

- / comUnedKe-) > , 



e 
\ 2 



> 



^E -<^(^)lj 

By the Cauchy-Schwarz inequality 
Taking square root of both sides completes the proof. 
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